Labeling of Gestures in SmartKom − Concept of the Coding System
نویسنده
چکیده
Dieser Report gehört zu Teilprojekt 1: Modalitätsspezifische Analysatoren Das diesem Technischen Dokument zugrundeliegende Forschungsvorhaben wurde mit Mitteln des Bundesministeriums für Bildung und Forschung unter dem Förderkennzeichen 01 IL 905 gefördert. Die Verantwortung für den Inhalt liegt bei den Autoren.
منابع مشابه
Labeling of Gestures in SmartKom - The Coding System
The SmartKom project is concerned with the development of an intelligent computer−user interface that allows almost natural communication and gesture input. For the training of the gesture analyzer, data is collected in so called Wizard−of−Oz experiments. Recordings of subjects are made and labeled off−line with respect to the gestures that were used. This article is concerned with the coding o...
متن کاملDevelopment of the User-State Conventions for the Multimodal Corpus in SmartKom
This contribution deals with the problem of finding procedures for the labeling of a multimodal data corpus that is created within the SmartKom project. The goal of the SmartKom project is the development of an intelligent computer-user interface that allows almost natural communication with an adaptive and self-explanatory machine. The system does not only accept input in form of natural speec...
متن کاملUser-State Labeling Procedures For The Multimodal Data Collection Of SmartKom
This contribution deals with the user-state labeling procedures of a multimodal data corpus that is created in the SmartKom project. The goal of the SmartKom project is the development of an intelligent computer-user interface that allows almost natural communication with an adaptive and self-explanatory machine. The system does not only allow input in the form of natural speech but also in the...
متن کاملMental Timeline in Persian Speakers’ Co-speech Gestures based on Lakoff and Johnson’s Conceptual Metaphor Theory
One of the introduced conceptual metaphors is the metaphor of "time as space". Time as an abstract concept is conceptualized by a concrete concept like space. This conceptualization of time is also reflected in co-speech gestures. In this research, we try to find out what dimension and direction the mental timeline has in co-speech gestures and under the influence of which one of the metaphoric...
متن کاملSmartkom: multimodal communication with a life- like character
SmartKom is a multimodal dialog system that combines speech, gesture, and mimics input and output. Spontaneous speech understanding is combined with the video-based recognition of natural gestures. One of the major scientific goals of SmartKom is to design new computational methods for the seamless integration and mutual disambiguation of multimodal input and output on a semantic and pragmatic ...
متن کامل